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Abstract 


A  new  method  for  image  magnification  using  fractal  based  technique  is  proposed. 
We  call  this  new  technique  fractal  image  magnification.  The  technique  is  designed 
assuming  the  self  transformability  property  of  images.  The  technique  described 
here  also  utilizes  Genetic  Algorithm  with  elitist  model  that  greatly  decreases  the 
search  for  finding  the  self  similarities  in  the  given  image.  The  article  presents 
theory  and  implementation  of  the  proposed  method.  A  simple  distortion  mea¬ 
sure  scheme  is  also  proposed  to  judge  the  image  quality  of  the  magnified  image. 
Comparison  with  one  of  the  most  popular  magnification  techniques,  the  nearest 
neighbor  technique,  is  made. 

Keywords:  Image  Magnification,  Iterated  Function  System  (IFS),  Genetic  Al¬ 
gorithm  (GA). 


1  Introduction 


Image  magnification  is  an  important  task  which  is  performed  to  bring  data  from 
different  sources  and  scales  to  a  common  scale.  This  type  of  preprocessing  is  very 
common  in  satellite  image  analysis  [1,  2].  Moreover  the  image  regions  which  are 
not  explicitly  visible  in  the  original  may  provide  more  information  after  magnifi¬ 
cation.  Like  other  image  processing  tasks,  the  magnification  is  performed  on  an 
input  image  which  is  represented  as  an  array  of  pixel  values  and  this  requires  huge 
memory  for  storage.  In  case  of  transmission  of  some  coded  version  of  the  image, 
magnification  can  be  performed  at  the  receiving  end  only  after  reconstructing 
the  image  from  its  code.  Thus  at  the  receiving  end,  besides  the  storage  problem, 
one  needs  to  perform  an  extra  computing  task  of  decoding.  So  it  is  beneficial  if 
one  can  reduce  the  storage  requirements  of  an  image  or  channel  bandwidth  in 
case  of  transmission  of  an  image  as  well  as  some  reduction  in  computing  load. 
The  formidable  problem  of  huge  memory  requirements  during  magnification  can 
greatly  be  minimized  by  developing  a  suitable  magnification  technique  which 
will  use  the  coded  representation  of  the  image  instead  of  using  the  original  image 
(uncoded  image).  Similarly  in  the  case  of  transmission,  if  the  coded  version  of 
the  image  is  directly  magnified  at  the  receiving  end  without  reconstruction  then 
this  will  also  reduce  the  cost  of  decoding  at  the  receiving  end.  With  this  problem 
in  mind  an  attempt  is  made  to  propose  a  new  magnification  technique  which  can 
be  applied  directly  on  the  coded  version  of  the  image. 

Fractal  image  coding  technique  is  one  of  the  efficient  approximate  image  coding 
techniques  available.  In  this  technique  utmost  care  is  taken  so  that  a  recon¬ 
structed  image  is  produced,  from  the  coded  version,  which  is  subjectively  very 
close  to  the  original  uncoded  image.  Actually  the  coded  image  representation 
must  implicitly  carry  all  the  spatial  information  associated  with  the  image.  Be¬ 
sides  the  spatial  information,  the  fractal  codes  carry  the  information  of  the  self 
similarities  present  in  the  image.  This  self  similarity  property  is  also  exploited 
in  the  proposed  image  magnification  technique.  We  call  it  as  fractal  image  mag¬ 
nification  technique. 
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Fractal  geometry  has  recently  come  into  the  limelight  due  to  its  use  m  various 
scientific  and  technological  applications,  specially  in  the  field  of  computer  based 
image  processing.  It  is  being  successfully  used  for  image  data  representation 
[3,  4]  and  as  image  processing  tool  [5,  6].  In  this  connection,  the  use  of  Iterative 
Function  System  (IFS)  and  Collage  theorem  [3]  have  shown  a  remarkable  im¬ 
provement  in  the  quality  of  processing  compared  to  that  obtained  using  existing 
image  processing  techniques. 

A  fully  automated  fractal  image  compression  scheme  of  digital  images  was  first 
proposed  by  Jacquin  [7].  The  basic  idea  of  fractal  image  compression  or  to 
find  the  fractal  codes  of  an  image  is  to  approximate  small  blocks,  called  range 
blocks,  of  the  given  image  from  large  blocks,  called  domain  blocks,  of  the  same 
image.  Thus  to  find  the  fractal  codes  for  a  given  image,  one  has  to  find,  for  each 
range  block  an  appropriate  mathematical  transformation  which  when  applied  to 
an  appropriate  domain  block  gives  rise  to  an  approximation  of  the  range  block. 
This  set  of  transformations  thus  obtained  by  partioning  the  whole  image  is  called 
Partitioned  Iterative  Function  System  (PIFS). 

Several  researchers  have  suggested  different  algorithms  with  diffeient  motivations 
to  obtain  PIFS  for  a  given  image.  We  have  already  suggested  a  faster  algorithm, 
to  obtain  PIFS,  using  Genetic  Algorithms  (GAs)  [8,  9].  GAs  [10,  11,  12]  are  opti¬ 
mization  algorithms  which  are  modeled  according  to  the  biological  evolutionary 
processes.  These  optimization  techniques  reduce  significantly  the  search  space 
and  time. 

In  the  present  work  an  attempt  is  made  to  use  fractal  codes  as  an  input  to  an 
image  magnification  system.  Some  of  the  popular  techniques  of  digital  magni¬ 
fication  of  images  are  nearest  neighbor,  bilinear  and  bicubic  interpolations.  All 
these  techniques  are  based  on  surface  interpolation.  In  the  interpolation  tech¬ 
niques  the  global  information  are  often  ignored  and  only  the  local  or  semi  global 
information  are  exploited.  But  in  the  proposed  scheme  the  magnification  task 
has  been  performed  by  using  fractal  codes  where  both  the  local  and  the  global 
information  are  used.  The  scheme  is  nothing  but  a  decoding  scheme  of  fractal 
codes  which  gives  rise  to  a  magnified  version  of  the  original  image.  The  article 
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reports  the  initial  results  of  magnification  using  fractal  codes  which  are  obtained 
by  a  GA  based  technique  [8,  9].  Comparison  with  the  nearest  neighbor  image 
magnification  methods  has  also  been  reported  here. 

In  the  magnification  techniques  the  distortion  due  to  blocking  which  is  a  local 
phenomenon  is  very  usual.  To  quantify  the  amount  of  distortion,  the  widely  used 
distortion  measure  is  mean  squared  error  (MSE)  or  some  other  version  of  it.  MSE 
is  a  global  measure  which  fails  to  account  properly  the  local  distortion  due  to 
blocking.  But  the  blocking  effects  are  very  much  sensitive  to  the  human  visual 
system.  So,  to  quantify  the  global  and  the  local  distortions  simultaneously  a 
new  distortion  measure  is  introduced.  The  overall  performances  of  the  proposed 
algorithm  is  found  to  be  satisfactory  with  respect  to  the  new  distortion  measure. 

Theory  and  key  features  of  IPS  and  magnification  using  IPS  are  outlined  in 
Section  2.  The  methodology  of  using  fractal  codes  for  magnification  of  a  given 
image  is  described  in  Section  3.  Section  4  presents  implementation  and  the 
results.  Discussion  and  conclusions  are  provided  in  Section  5. 


2  Theory  and  Basic  Principles 

The  detailed  mathematical  description  of  the  IPS  theory.  Collage  theorem  and 
other  relevant  results  are  available  in  [3,  13,  14].  Only  the  salient  features  are 
discussed  here.  The  theory  of  IPS  and  its  use  in  image  coding  and  in  image 
magnification  are  described  in  the  following  subsections.  The  basic  principle  of 
Genetic  Algorithms  is  also  described. 

2.1  Theoretical  Foundation  of  IFS 

Let  /  be  a  given  image  which  belongs  to  the  set  X.  Generally  X  is  taken  as  the 
collection  of  compact  sets.  Our  intention  is  to  find  a  set  T  of  affine  contractive 
maps  for  which  the  given  image  I  is  an  approximate  fixed  point.  The  fixed  point 
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or  attractor  “A”  of  the  set  of  maps  T  is  defined  as  follows  : 

lim  =  A,  VJ  €  A^, 

N-^OO 

and  ^{A)  =  A,  where  {J)  is  defined  as 

),with 

J^\J)  =  ^(7),  VJ€X. 

Also  the  set  of  maps  ^  is  defined  as  follows: 

d(^(i7i), J2))  ^  ■§  d(t7i, J2))  €  X  and  0  <  s  <  1.  (1) 

Here  “c?”  is  called  the  distance  measure  and  “s”  is  called  the  contractivity  factor 
of  :F. 

Let  d(/,:F(/))<e  (2) 

where  e  is  a  small  positive  quantity.  Now,  by  Collage  theorem  [1],  it  can  be 
shown  that 

d{l,A)<-^  (3) 

Here,  (A, .7^)  is  called  iterative  function  system  and  J-  is  called  the  set  of  fractal 
codes  for  the  given  image  /. 

2.1.1  Image  Coding  Using  IFS 

Let,  7  be  a  given  image  having  size  w  x  w  and  the  range  of  gray  level  values  be 
Thus  the  given  image  7  is  a  subset  of  IR^.  The  image  is  partitioned  into  n 
non  overlapping  squares  of  size,  say  6x6,  and  let  this  partition  be  represented 
by  =  {'^ii'R'2-,  -  •  •  Each  TZi  is  named  as  range  block  where,  n  =  f  x  f. 

Let  'D  be  the  collection  of  all  possible  blocks  (within  the  image  support)  which 
is  of  size  26  x  26  and  let  V  =  {I)i,X>2?  •  •  *  Each  Vj  is  named  as  domain 

block  with  m  =  {w-2b)  X  {w  -  26).  Let, 

—  {f  •  IR^  ;  /  is  an  affine  contractive  map}. 
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Now,  for  a  given  rairge  block  "R,,  let,  fiy  €  Tj  be  such  that 
Now  let  k  be  such  that 

d{ni,  fi\k{T>k))  =  mjn{  diHi,  }  (4) 

Also,  let  fi\k{T^k)  =  '^i\k- 

Our  aim  is  to  ftrrd  R,|t  for  each  i  €  {1,2, ■■■,«)  or  in  other  words  for  each 
range  block  {IZi)  we  are  to  find  appropriately  matched  domain  block  (Pfc)  an 
appropriately  matched  map  (/.„)•  Thus  {VkJi\k}  is  called  fractal  code  for  TZ,. 
Figure  1  illustrates  the  mapping  of  domain  blocks  to  the  range  blocks. 

2.2  Image  Magnification  Using  Fractal  Codes  (IFS) 

The  transformation  f^k  consists  of  two  parts.  The  first  part  is  contraction.  This 
contraction  operation  is  applied  on  the  domain  block  in  such  a  way  that  its 
size  becomes  equal  to  the  size  of  the  concerned  range  block.  The  second  part 
is  transformation.  Here  the  transformations  of  rows  and  columns  of  contracted 
domain  block  to  that  of  the  range  block  are  obtained  by  using  eight  possible 
isometric  transformations  [7]  and  simple  coordinate  geometry.  The  gray  value 
transformation,  in  this  part,  is  obtained  by  least  square  technique  i.e.  by  fitting 
a  straight  line  using  two  sets  of  pixel  values  of  which  one  is  from  range  block  and 
other  is  from  contracted  domain  block.  Thus  /.,fc  can  be  looked  upon  as  mixture 
of  two  transformations,  ,  where,  C  is  contraction  operation  and  t^k 

is  transformation  for  rows,  columns  and  gray  values.  As  the  size  of  the  domain 
block  is  double  that  of  the  range  block,  an  average  of  four  neighboring  pixels  are 
taken  to  construct  a  contracted  domain  block  for  the  implementation  purpose  of 
the  contractive  operator. 

n 

Thus  we  have,  /  = 

t  =  l 
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(6) 


Now,  let  be  a  magnification  operator  such  that 


d{  )  <  ei 

<■=1  «=i 

where  Ci  is  a  small  positive  quantity.  Now  by  (5)  and  (6)  we  have 

d{  \jnu  [jM{%\k)  )  <  ^2 

t=l  «=1 

where  €2  ^  small  positive  quantity.  Again,  we  have, 

Win  =  MVt)  =  i.nC  (»i). 


<i(  UWi.  U  ^  '•!» 

1=1  1=1 

Now,  reconstruction  of  images  using  the  operator  M  should  be  an 
contraction  operation  using  the  operator  C.  So,  by  (7)  and  (8) 


(8) 


inverse  of 


d  (  M  {Tliik)  ,  )  <  es- 


(9) 


XiV.  ^  ^ 

1=1  i=l 

Both  €3  and  £4  are  small  positive  quantities. 

Thus  from  (10),  it  is  clear  that  there  is  no  need  of  constructing  the  magnification 
operator  M,  only  the  second  part  of  the  fractal  codes  has  to  be  applied  on  the 
domain  block  to  get  an  image  which  is  very  close  to  the  given  image  /  and  this 
image  has  size  double  that  of  the  given  image. 


2.3  Genetic  Algorithm 

Genetic  Algorithms  (GAs)  [10, 11, 12]  are  highly  parallel  and  adaptive  search  and 
machine  learning  process  based  on  a  natural  selection  mechanism  of  biological 
genetic  system.  Parallelism  of  GAs  depend  upon  the  machine  used  for  computa¬ 
tions.  GAs  help  to  find  the  global  optimal  solution  without  getting  stuck  at  local 
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optima  as  they  deal  with  multiple  points  (called,  chromosomes)  simultaneously. 
To  solve  the  optimization  problem,  GAs  start  with  the  chromosomal  (structural) 
representation  of  a  parameter  set.  The  parameter  set  is  coded  as  a  string  of  finite 
length  called  chromosome  or  simply  string.  Usually,  the  chromosomes  are  strings 
of  O’s  and  I’s.  If  the  length  of  chromosome  (string)  is  I  then  total  number  of 
chromosomes  is  2^  To  find  a  near  optimal  solution,  three  basic  genetic  operators, 
i)Selection,  ii)Crossover  and  iii)Mutation  are  exploited  in  GAs. 

In  selection  procedure  the  objective  function  or  the  fitness  function  of  each  in¬ 
dividual  string  is  responsible  for  its  selection  as  a  new  string  in  the  next  mating 
pool.  We  have  used  the  elitist  model  of  GAs  where  the  worst  string  in  the 
present  generation  is  replaced  by  the  best  string  of  the  previous  generation.  The 
crossover  operation  on  a  pair  of  strings  is  described  here.  An  integer  position 
k  is  selected  randomly  between  1  and  /  —  1  (/  >  1).  Two  new  strings  are  then 
created  by  swapping  all  the  characters  from  position  +  1  to  /  of  old  strings. 
This  process  is  very  often  in  natural  genetic  system  and  thus,  a  high  probability 
is  assigned  to  indicate  the  occurrence  of  this  operation.  In  mutation  operation 
every  bit  of  every  string  is  replaced  by  the  reverse  character  (i.e.  0  by  1  and  1 
by  0)  with  some  probability.  Usually  a  low  probability  is  assigned  for  mutation 
operation  and  the  occurrence  of  this  operation  is  guided  by  this  probability.  We 
have  used  the  varying  mutation  probability  scheme  [15]  to  guide  the  mutation 
operation  in  the  present  work.  Starting  from  the  initial  population  (of  strings)  a 
new  population  is  created  using  three  genetic  operators  as  described  above.  This 
entire  process  is  called  an  iteration.  In  GAs  a  considerable  number  of  iterations 
are  performed  to  find  the  optimal  solution.  The  string  which  possesses  optimal 
fitness  value  among  all  the  strings  is  called  the  optimal  string.  The  optimality  of 
the  fitness  value  of  strings  is  problem  dependent.  If  the  problem  is  a  minimizing 
problem,  the  lowest  fitness  value  is  taken  as  the  optimal  one  and  the  maximum 
fitness  value  is  selected  as  the  optimal  one  if  the  problem  is  a  maximization  prob¬ 
lem.  The  convergence  of  GAs  to  an  optimal  solution  is  assured  as  the  number  of 
iterations  increases  [16]. 

The  methodologies  to  obtain  magnified  images  from  fractal  codes  are  now  dis¬ 
cussed  below. 
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3  Methodology 


So  far  we  have  discussed  how  to  apply  the  fractal  codes  or  IFS  to  get  a  magnified 
image  which  is  double  in  size  that  of  the  given  image.  On  successive  applications 
of  this  proposed  algorithm,  magnification  by  factor  4,  8,  16  etc.  can  also  be 
achieved.  But  the  first  task  is  to  obtain  the  fractal  codes  or  IFS  for  a  given 

image. 

3.1  Construction  of  IFS  for  magnification 

The  size  of  the  range  blocks  plays  an  important  role  in  image  compression  as 
well  as  magnification.  If  small  blocks  are  taken,  the  finer  details  of  the  image 
are  preserved  and  restored  in  the  decompressed  image  but  the  compression  ratio 
will  be  less.  On  the  other  hand  more  compression  will  be  achieved,  at  the  cost 
of  finer  image  details,  if  large  range  blocks  are  considered.  Thus  a  trade  off  has 
to  be  made  to  get  quality  decompressed  image  as  well  as  considerable  amount  of 
compression.  But  the  main  task  in  magnification  is  only  to  restore  all  the  image 
details  and  almost  no  emphasis  is  given  on  the  amount  of  compression  achieved. 
So,  in  this  case,  small  range  blocks  are  to  be  considered  to  keep  track  with  every 
minute  details  of  the  original  image. 

In  the  proposed  algorithm,  to  obtain  the  fractal  codes  of  small  range  blocks 
of  a  given  image,  the  blocks  are  first  classified  into  two  groups  using  a  simple 
classification  scheme  [9].  The  groups  are  formed  according  to  the  variability  of 
the  pixel  values  in  the  blocks.  If  the  variability  of  a  block  is  low  r.e.,  if  the 
variance  of  the  pixel  values  in  the  block  is  below  a  fixed  value,  called  threshold, 
we  call  the  block  as  smooth  type  range  block.  Otherwise  we  call  it  a  rough  type 
range  block.  The  threshold  value  to  separate  the  range  blocks  into  two  types 
is  obtained  from  the  valley  in  the  histogram  of  the  variances  of  pixel  values  of 
the  blocks.  All  the  pixel  values  in  a  smooth  type  range  block  are  replaced  by 
the  mean  of  its  pixel  values.  So,  it  is  enough  to  store  only  the  discretized  mean 
value.  On  the  other  hand  for  each  rough  type  range  block,  the  appropriately 
matched  domain  block  as  well  as  appropriately  matched  transformation  from 
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eight  possible  isometric  transformations  [7]  have  to  be  searched  out.  To  solve 
this  search  problem  a  GA  based  technique  [8,  9]  is  adopted.  GA  is  a  search 
technique  which  finds  out  the  optimal  solution  faster  than  the  exhaustive  search 
technique. 

3.2  GA  to  Find  IFS 

The  parameters  which  are  to  be  searched  using  G  A  are  location  (starting  row  and 
starting  column)  of  domain  block  and  its  eight  possible  isometric  transformations 
[7].  The  realization  of  the  first  is  two  integer  values  between  1  and  lo  -  2b  and 
the  second  can  take  any  value  between  1  and  8.  Binary  strings  of  length  /  are 
introduced  to  represent  the  parameter  set.  Here  I  is  chosen  in  such  a  way  that 
the  set  of  2^  binary  strings  exhausts  the  whole  parametric  space. 

A  string  indicates  the  location  and  the  isometric  transformation  of  a  domain 
block.  In  fractal  codes  we  are  to  find  an  appropriate  domain  block  and  an 
appropriate  transformation  for  each  range  block.  In  other  words  we  are  to  find 
the  appropriate  string  for  each  range  block.  Out  of  2^  strings  a  few  strings  aie 
selected  randomly  to  start  the  GA.  Starting  with  the  initial  mating  pool  and 
using  the  three  basic  operations  new  populations  are  generated  in  each  iteiation 
of  the  GA.  After  a  large  number  of  iterations,  the  GA  will  produce  a  near  global 
optimal  solution.  To  obtain  the  appropriate  string  in  each  step  we  are  to  calculate 
the  fitness  function  of  each  string  in  each  iteration.  Mean  square  error  (MSE)  is 
used  as  fitness  function  of  a  string.  In  each  mating  pool,  the  strings  first  under 
go  crossing  over  operation  pairwise  and  the  mutation  operation  is  applied  in  each 
bit  of  each  string. 

In  the  next  section  the  technique  for  successive  magnification  has  been  described. 


3.3  Successive  Magnification 

In  the  case  of  successive  applications  of  the  algorithm,  the  fractal  codes  need 
not  be  computed  afresh.  The  fractal  codes  that  are  used  in  a  step  are  obtained 
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by  modifying  the  fractal  codes  obtained  in  the  previous  step.  In  particular,  the 
transformations  ti\k  are  modified  by  using  the  image  that  is  already  obtained  m 
the  previous  step.  The  locations  of  the  appropriately  matched  domain  blocks 
are  kept  fixed  in  all  the  steps.  Only  the  size  of  the  domain  blocks  is  increased  in 
the  modification  process  of  the  fractal  codes.  Thus,  in  particular,  only  the  gray 
level  transformation  in  is  to  be  modified.  The  gray  level  transformations 
are  obtained  using  least  square  technique.  In  this  technique  a  straight  line  is 
fitted  with  two  sets  of  gray  level  values  of  which  one  is  from  range  block  and 
other  is  from  contracted  domain  block.  In  the  successive  magnification  scheme 
these  two  sets  are  enlarged.  These  enlarged  sets  are  divided  into  several  parts 
and  separate  straight  lines  are  fitted  for  each  parts  using  the  same  least  square 
technique.  For  the  magnification  by  a  factor  4  the  sets  are  divided  into  4  parts 
and  for  the  magnification  by  a  factor  8,  16  parts  are  considered  separately  and 
so  on.  So,  the  number  of  fractal  codes,  in  a  step,  becomes  4  times  larger  than  its 
counter  part  in  the  previous  step.  So,  it  is  enough  to  find  the  fractal  codes  in  the 
case  of  magnification  by  a  factor  2  and  in  other  cases  these  codes  are  modified 
accordingly.The  modified  codes  are  then  used  for  the  magnification  greater  than 
two. 

In  the  next  section  we  have  discussed  the  evaluation  criteria  to  judge  the  perfor¬ 
mance  of  the  proposed  algorithm. 


3.4  Fidelity  Criteria 

The  magnified  image  has  been  reconstructed  from  the  fractal  codes  which  aie 
obtained  by  using  the  GA  based  technique  [8,  9].  The  next  task  is  to  judge  the 
performance  of  the  proposed  fractal  based  image  magnification  algorithm.  For 
this  purpose  one  has  to  measure  the  distortion  between  the  given  image  and 
the  reconstructed  image.  To  quantify  the  amount  of  distortion,  the  widely  used 
distortion  measure  is  Mean  Squared  Error  (MSE)  or  some  modified  form  of  it 
like  Peak  Signal  to  Noise  Ratio  (PSNR).  MSE  or  PSNR  examines  the  similarities 
between  two  images.  But  MSE  is  a  size  dependent  measure  i.e.,  the  two  images, 
under  consideration,  should  have  the  same  size.  Moreover  it  is  a  global  measure 
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which  is  the  average  of  pixel  to  pixel  difference.  It  does  not  precisely  indicate  the 
large  and  significant  local  distortions  due  to  blocking  or  blurring  as  it  deals  with 
the  average  distortions.  But  the  blocking  effects  are  very  much  sensitive  to  the 
human  visual  system.  So,  one  has  to  think  of  a  size  independent  measure  which 
can  keep  track  with  local  as  well  as  global  distortions  simultaneously  to  judge  the 
performances  of  magnification  task.  A  new  fidelity  criteria  whose  performance 
is  also  similar  to  that  of  visual  judgment  is  introduced  to  find  out  the  distortion 
between  the  given  image  and  the  magnified  reconstructed  image.  The  overall 
performances  of  the  proposed  algorithm  is  found  to  be  satisfactory  both  in  the 
light  of  this  new  distortion  measure  (objectively)  as  well  as  from  visual  judgment 
(subjectively). 

The  images  that  are  obtained  from  the  codes  usually  have  specific  artifacts  such 
as  blocking,  ringing  and  blurring.  Actually  these  artifacts  are  reflected  more 
prominently  in  the  high  frequency  component  of  the  image  and  are  very  sensible 
to  the  human  visual  system  [17].  So,  in  our  proposed  error  measure,  we  have  tried 
to  measure  the  errors  in  edges.  For  simplicity  only  the  vertical  and  horizontal 
edges  have  been  considered. 

Both  the  images  are  first  partitioned  into  blocks  proportional  to  their  respective 
sizes  in  such  a  way  that  both  images  contain  equal  number  of  blocks.  The  error 
is  then  measured  block  wise  and  finally  the  average  error  is  noted.  To  detect 
the  edges  of  each  block  we  have  used  the  scheme  suggested  by  Ramamurthi  et 
al.  [18].  The  edge  blocks  consist  of  value  “0”  and  ‘T”  where,  ‘T”  represents 
the  presence  of  edge.  Now  it  is  expected  that  the  original  and  the  magnified 
blocks  should  have  same  type  of  edge  distributions.  In  other  words  the  expected 
run  of  “1”  present  in  both  the  blocks  should  be  same  if  normalized  by  their 
respective  sizes.  Thus  the  error  measure  is  defined  by  the  difference  between  the 
normalized  expected  “run”  of  “1”  present  in  the  given  image  and  in  the  magnified 
reconstructed  image.  The  vertical  and  horizontal  edges  are  considered  separately 
and  then  averaged  to  give  rise  the  final  error  measure  of  a  block.  The  algorithm 
of  the  proposed  error  criteria  is  described  below. 
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3.4.1  Description  of  the  algorithm 

Step  1  :  Partition  the  images,  /j  and  I2  (with  size  of  I\  less  than  size  of  I2) 
into  square  blocks  such  that  the  number  of  partitions  is  same  in  both  the  images. 
Let  Pi  and  p2  (with  pi  <  P2)  be  the  sizes  of  the  square  blocks  for  the  images  h 
and  I2  respectively.  Let  these  blocks  be  Bn,  Bn-,  "  '  1  Bin  B21,  ^22? ' ' '  i  -^zn- 

Step  2  :  From  i  =  1 , 2  and  j  =  1 , 2,  •  •  • ,  n  compute  gradient  matrices.  Let 
Gfj  and  be  respectively  the  horizontal  and  the  vertical  gradient  matrix.  The 
elements  of  the  gradient  matrices  are  all  either  0  or  1.  The  gradient  matiices  are 
defined  as  follows 

Gf,(m,n)  =  0  if  <  r 

2 

=  1  if  Otherwise. 

and 

GUm,n)  =  0  if 

2 

=  1  if  Otherwise. 

Here  gm  n  —  Gray  level  value  of  {m,n)th  pixel  in  a  block  and  T  =  A  prefixed 
threshold  value. 

Step  3  :  Find  the  expected  run  of  1  present  in  both  horizontal  and  vertical 
directions  in  both  G^j  and  Gjj.  Let  L  be  the  random  variable  denoting  the 
number  of  run  of  1  in  a  particular  gradient  matrix  in  a  particular  direction. 
Compute  E^p{L)  ,  E^f{L)  ,  Fv^(L)  ,  E^f{L).  Here  expected  run  of  1  is  defined 
as 

Number  of  times  the  run  of  length  k  appears 
Total  number  of  run  {of  all  possible  lengths)  present 

Now  compute 

E^f{L)  +  Et^{L)  +  Ev!^{L)  +  Eyf{L) 

hij[L)  ~  • 

Step  4  :  Normalize  Eij{L)  by  respective  block  size. 

Ei,n)  =  SiTFr  •/  ■  =  ' 

_  Eij(^  -f  ’9 
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E  between  the  two  given  images  h 


Step  5  :  compute  the  final  error  measure 
and  I2.  -B  is  defined  as 

£:  =  i  ’tiE.iW- 

The  next  section  deals  with  the  implementation  and  the  experimental  results  of 
the  proposed  algorithm. 


4  Implementation 

To  find  the  fractal  codes  for  a  given  image  the  search  is  to  be  made  for  all  possible 
domain  blocks  as  well  as  eight  possible  isometric  transformations  [7].  To  reduce 
the  search  space  and  time  Genetic  Algorithm  is  used  instead  of  exhaustive  search. 
The  search  space  reduction  is  achieved  since  near  optimal  solutions  are  usually 
satisfactory  and,  intuitively,  solutions  which  are  far  away  from  the  expected  are 
rejected  in  a  probabilistic  manner.  This  is  the  reason  for  GA  to  perform  well  foi 
optimization  problems.  We  have  already  shown  that  the  performances  of  GAs 
to  find  fractal  codes  of  a  given  image  [9].  The  results  are  quite  satisfactory  and 
at  least  20  times  reductions  in  the  search  spaces  are  achieved. 

For  the  specific  implementation  of  the  proposed  algorithm  a  part  of  the  original 
“Lena”  image  (Figure  2(a))  is  treated  as  the  original  input  image.  The  input 
image  is  a  128  x  128,  8  bit/pixel  image.  The  GA  based  technique  [9]  is  applied 
to  generate  the  fractal  codes.  Moreover  a  simple  classification  scheme  [9]  for 
range  blocks  have  been  adopted  to  retain  the  details  of  similar  looking  regions 
of  the  given  image  more  easily.In  classification  scheme,  the  range  blocks  are 
grouped  into  two  classes  viz.^  “smooth”  and  “rough”.  In  the  case  of  magnification 
algorithm,  small  range  blocks  of  size  2x2  are  considered  for  the  computation 
of  fractal  codes.  Using  these  codes  an  image  of  size  256  x  256  is  reconstructed 
which  is  two  times  magnified  than  the  original  image.  This  image  is  found  to  be 
very  close  to  the  original  image  which  is  judged  by  the  error  measure  as  described 
in  section  3.4.  These  fractal  codes  are  then  modified  stepwise  to  get  the  images 
which  are  4  times  and  8  times  magnified  than  the  original  one.  In  each  step  the 
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ei'i'or,  in  comparison  to  its  previous  step,  is  measured  successively.  The  proposed 
algorithm  is  also  compared  in  terms  of  new  distortion  measure  with  the  nearest 
neighbour  technique  for  image  magnification.  Nearest  neighbour  is  the  simplest 
method  of  digital  magnification.  Given  an  image  of  size  w  x  w,  to  magnify  it  by 
a  factor  k,  every  pixel  in  the  new  image  is  assigned  the  gray  value  of  the  pixel 
in  the  original  image  which  is  nearest  to  it.  This  is  equivalent  to  repeating  the 
gray  values  k  x  k  times  to  obtain  the  magnified  image.  The  resultant  image  for 
large  magnification  factors  will  have  prominent  block  like  structures  due  to  lack 
of  smoothness. 

The  proposed  algorithm  has  also  been  implemented  on  a  “Low  Flying  Aircraft” 
(LFA)  image  having  size  128  x  128  and  range  of  gray  level  values  0  to  255.  Other 
parameters  of  the  algorithm  are  kept  fixed  as  in  the  case  of  “Lena”  image.  All 
the  results  obtained  are  presented  in  Table  1.  The  original  and  magnified  images 
of  “Lena”  and  “LFA”  images  are  shown  in  Figure  2  to  Figure  7. 


Table  1:  Test  results  obtained  in  Image  magnification  Algorithms 


Image 

Reconstructed  Image  Statistics 

MF 

Error 

MF 

Error 

MF 

Error 

Fractal 

NN 

Fractal 

NN 

Fractal 

NN 

Lena 

2 

1.18 

1.62 

4 

1.37 

3.11 

8 

1.24 

6.15 

LFA 

2 

2.32 

2.37 

4 

2.85 

4.59 

8 

2.43 

9.11 

MF=Magnification  Factor  and  NN=Nearest  Neighbour 


5  Discussion  and  Conclusions 

An  important  advantage  of  fractal  image  magnification  is  that  it  magnifies  the 
image  by  expanding  the  fractal  codes  or  the  transformations  which  may  be  looked 
upon  as  independent  of  image  resolution.  The  only  error  involved  with  it  is  the 
problem  of  discretization.  Thus  the  structure  and  the  shape  of  the  image  remains 
almost  same.  In  a  sense,  it  is  like  interpolation  resulting  in  a  sharper  expanded 
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image.  Other  image  magnification  schemes  use  pixel  replication  to  expand  image. 
Pixel  replication  makes  an  image  blocky,  blurry  and  patchy  after  a  certain  extent 
of  expansion. 

The  proposed  technique  of  fractal  image  magnification  utilizes  the  coded  (fractal) 
version  of  the  input  image  instead  of  the  original  image.  Therefore  it  is  cost 
effective  in  the  sense  of  storage  space  and  time  as  no  decoding  is  performed  at 
the  receiving  end  in  case  of  transmission  of  the  codes. 

In  this  article  fractal  image  magnification  algorithm  is  implemented  with  mag¬ 
nification  factors  which  are  multiples  of  2.  But  in  practice  one  may  need  to 
magnify  the  given  image  by  other  factors  too.  One  way  of  performing  this  task 
is  to  select  the  domain  blocks  which  are  3  times  larger  than  that  of  the  range 
block.  Now  the  image  can  be  magnified  3  times  using  the  corresponding  fractal 
codes.  Hence  magnification  by  factors  which  are  multiples  of  3  can  be  achieved. 
On  the  other  hand,  magnification  by  factors  which  are  not  multiples  of  2  or  3 
can  also  be  achieved  by  considering  the  normalized  distance  between  the  range 
block  and  its  matched  domain  block  in  the  original  image.  While  performing 
the  magnification  task,  if  the  distance  between  the  range  block  and  the  domain 
block  appears  to  be  fractional,  one  has  to  discretize  it  properly.  Moreover  this 
normalized  distance  can  also  be  utilized  for  the  magnification  by  any  factor. 

The  size  of  the  range  blocks  considered  plays  a  vital  role  in  fractal  image  com¬ 
pression  and  fractal  image  magnification  (ref.  section  3.1).  In  particular  these 
two  algorithms  are  in  opposite  direction  from  the  point  of  view  of  range  block 
size.  So,  one  can  think  of  an  optimal  range  block  size  for  which  good  quality 
magnified  images  can  be  reconstructed  from  the  fractal  codes  and  at  the  same 
time  considerable  amount  of  compression  (in  terms  of  compression  ratio)  can  be 
achieved.  To  solve  this  problem  one  can  think  of  quadtree  partitioning  of  the 
images  instead  of  square  partitioning  while  generating  the  fractal  codes  [19].  An¬ 
other  scheme,  to  obtain  the  IPS  codes  of  an  image,  suggested  by  Thomas  et  al. 
[20]  can  also  be  adopted  in  this  connection.  In  this  scheme  they  have  considered 
irregular  shaped  range  blocks.  Automatically  the  matched  domain  blocks  are 
just  the  scaled  and  magnified  version  of  these  irregular  shaped  range  blocks. 
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In  the  present  article  we  have  introduced  a  new  distortion  measure  or  fidelity 
criteria  to  judge  the  performance  of  the  proposed  algorithm.  Instead  of  using  this 
distortion  measure  one  can  adopt  some  nonparametric  statistical  tests  [21]  for  the 
same  purpose.  The  common  tests  for  examining  the  degree  of  association  between 
two  distributions  whose  distribution  functions  are  unknown  are  Sign  test,  Wald 
Wolfowitz  Run  test,  Wilcoxson  test  and  Kolmogorov  Smirnov  test.  Another 
evaluating  criteria  based  on  fractal  dimension  has  already  been  suggested  by 
Lalitha  et  al.  [22].  But  the  most  important  feature  which  should  be  considered 
while  examining  the  similarities  between  two  images  is  the  edge  distribution  of 
the  images  as  the  edges  are  very  sensitive  to  human  eyes.  But  neither  the  fractal 
based  evaluating  criteria  nor  the  statistical  tests  take  care  of  distortions  present 
in  the  edges.  So,  one  of  the  important  tasks  is  to  find  the  proper  edges  in  the 
images  for  the  implementation  of  the  proposed  distortion  measure.  We  have  used 
a  very  simple  technique  for  the  detection  of  edges  though  one  may  suggest  more 
complex  techniques  for  it.  The  overall  performance  of  the  proposed  fractal  based 
image  magnification  technique  is  good.  The  proposed  distortion  measure  also 
appears  to  be  satisfactory  and  compatible  with  visual  judgment. 
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Figure  Captions 


Figure  1  :  Mapping  from  Domain  blocks  to  Range  blocks. 

Figure  2(a)  :  Original  "Lena”  image. 

Figure  2(b)  :  Decoded  "Lena”  image. 

Figure  3(a)  :  Two  times  magnified  image  of  “Lena”  using  Fractal  Image  Mag¬ 
nification  Technique. 

Figure  3(b)  :  Four  times  magnified  image  of  “Lena”  using  Fractal  Image  Mag¬ 
nification  Technique. 

Figure  3(c)  :  Eight  times  magnified  image  of  “Lena”  using  Fractal  Image  Mag¬ 
nification  Technique. 

Figure  4(a)  :  Two  times  magnified  image  of  "Lena”  using  Nearest  Neighbour 
Technique. 

Figure  4(b)  :  Four  times  magnified  image  of  “Lena”  using  Nearest  Neighbour 
Technique. 

Figure  4(c)  :  Eight  times  magnified  image  of  “Lena”  using  Nearest  Neighbour 
Technique. 

Figure  5(a)  :  Original  "LFA”  image. 

Figure  5(b)  :  Decoded  “LF.A”  image. 

Figure  6(a)  :  Two  times  magnified  image  of  “LF.\  using  Fractal  Image  Mag¬ 
nification  Technique. 

Figure  6(b)  :  Four  times  magnified  image  of  “LFA”  using  Fractal  Image  Mag¬ 
nification  Technique. 

Figure  6(c)  :  Eight  times  magnified  image  of  “LFA”  using  Fractal  Image  Mag¬ 
nification  Technique. 

Figure  7  :  Eight  times  magnified  image  of  “LFA  ’  using  Nearest  Neighbour 
Technique. 
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